Fooling Partial Dependence via Data Poisoning

نویسندگان

چکیده

Many methods have been developed to understand complex predictive models and high expectations are placed on post-hoc model explainability. It turns out that such explanations not robust nor trustworthy, they can be fooled. This paper presents techniques for attacking Partial Dependence (plots, profiles, PDP), which among the most popular of explaining any trained tabular data. We showcase PD manipulated in an adversarial manner, is alarming, especially financial or medical applications where auditability became a must-have trait supporting black-box machine learning. The fooling performed via poisoning data bend shift desired direction using genetic gradient algorithms. believe this first work algorithm manipulating explanations, transferable as it generalizes both ways: model-agnostic explanation-agnostic manner.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Bayesian modeling of the dependence in longitudinal data via partial autocorrelations and marginal variances

Many parameters and positive-definiteness are two major obstacles in estimating and modelling a correlation matrix for longitudinal data. In addition, when longitudinal data is incomplete, incorrectly modelling the correlation matrix often results in bias in estimating mean regression parameters. In this paper, we introduce a flexible and parsimonious class of regression models for a covariance...

متن کامل

Deterministic Sparse Fourier Approximation via Fooling Arithmetic Progressions

A significant Fourier transform (SFT) algorithm, given a threshold τ and oracle access to a function f , outputs (the frequencies and approximate values of) all the τ -significant Fourier coefficients of f , i.e., the Fourier coefficients whose magnitude exceeds τ‖f‖2. In this paper we present the first deterministic SFT algorithm for functions f over ZN which is: (1) Local, i.e., its running t...

متن کامل

Conditional Dependence in Longitudinal Data Analysis

Mixed models are widely used to analyze longitudinal data. In their conventional formulation as linear mixed models (LMMs) and generalized LMMs (GLMMs), a commonly indispensable assumption in settings involving longitudinal non-Gaussian data is that the longitudinal observations from subjects are conditionally independent, given subject-specific random effects. Although conventional Gaussian...

متن کامل

Fooling-sets and rank

ABSTRACT. An n×n matrix M is called a fooling-set matrix of size n if its diagonal entries are nonzero and Mk,lMl,k = 0 for every k 6= l. Dietzfelbinger, Hromkovič, and Schnitger (1996) showed that n ≤ (rkM)2 , regardless of over which field the rank is computed, and asked whether the exponent on rkM can be improved. We settle this question. In characteristic zero, we construct an infinite fami...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Lecture Notes in Computer Science

سال: 2023

ISSN: ['1611-3349', '0302-9743']

DOI: https://doi.org/10.1007/978-3-031-26409-2_8